Predicting blunt cerebrovascular injury in pediatric trauma: Validation of the Utah Score

Risk factors for blunt cerebrovascular injury (BCVI) may differ between children and adults, suggesting that children at low risk for BCVI after trauma receive unnecessary computed tomography angiography (CTA) and high-dose radiation. We previously developed a score for predicting pediatric BCVI based on retrospective cohort analysis. Our objective is to externally validate this prediction score with a retrospective multi-institutional cohort. We included patients who underwent CTA for traumatic cranial injury at four pediatric Level I trauma centers. Each patient in the validation cohort was scored using the “Utah Score” and classified as high or low risk. Before analysis, we defined a misclassification rate <25% as validating the Utah Score. Six hundred forty-five patients (mean age 8.6 ± 5.4 years; 63.4% males) underwent screening for BCVI via CTA. The validation cohort was 411 patients from three sites compared with the training cohort of 234 patients. Twenty-two BCVIs (5.4%) were identified in the validation cohort. The Utah Score was significantly associated with BCVIs in the validation cohort (odds ratio 8.1 [3.3, 19.8], p < 0.001) and discriminated well in the validation cohort (area under the curve 72%). When the Utah Score was applied to the validation cohort, the sensitivity was 59%, specificity was 85%, positive predictive value was 18%, and negative predictive value was 97%. The Utah Score misclassified 16.6% of patients in the validation cohort. The Utah Score for predicting BCVI in pediatric trauma patients was validated with a low misclassification rate using a large, independent, multicenter cohort. Its implementation in the clinical setting may reduce the use of CTA in low-risk patients

A Clinical Prediction Score to Guide Referral of Elderly Dialysis Patients for Kidney Transplant Evaluation.

IntroductionDialysis patients aged ≥70 years derive improved life expectancy through kidney transplantation compared to their waitlisted counterparts, but guidelines are not clear about how to identify appropriate transplantation candidates. We developed a clinical prediction score to identify elderly dialysis patients with expected 5-year survival appropriate for kidney transplantation (&gt;5 years).MethodsIncident dialysis patients in 2006-2009 aged ≥70 were identified from the United States Renal Data System database and divided into derivation and validation cohorts. Using the derivation cohort, candidate variables with a significant crude association with 5-year all-cause mortality were included in a multivariable logistic regression model to generate a scoring system. The scoring system was tested in the validation cohort and a cohort of elderly transplant recipients.ResultsCharacteristics most predictive of 5-year mortality included age &gt;80, body mass index (BMI) &lt;18, the presence of congestive heart failure (CHF), chronic obstructive pulmonary disease (COPD), immobility, and being institutionalized. Factors associated with increased 5-year survival were non-white race, a primary cause of end stage renal disease (ESRD) other than diabetes, employment within 6 months of dialysis initiation, and dialysis start via arteriovenous fistula (AVF). 5-year mortality was 47% for the lowest risk score group (3.6% of the validation cohort) and &gt;90% for the highest risk cohort (42% of the validation cohort).ConclusionThis clinical prediction score could be useful for physicians to identify potentially suitable candidates for kidney transplantation

Risk Model Development and Validation for Prediction of Coronary Artery Aneurysms in Kawasaki Disease in a North American Population.

Background Accurate prediction of coronary artery aneurysms ( CAAs ) in patients with Kawasaki disease remains challenging in North American cohorts. We sought to develop and validate a risk model for CAA prediction. Methods and Results A binary outcome of CAA was defined as left anterior descending or right coronary artery Z score ≥2.5 at 2 to 8&nbsp;weeks after fever onset in a development cohort (n=903) and a validation cohort (n=185) of patients with Kawasaki disease. Associations of baseline clinical, laboratory, and echocardiographic variables with later CAA were assessed in the development cohort using logistic regression. Discrimination (c statistic) and calibration (Hosmer-Lemeshow) of the final model were evaluated. A practical risk score assigning points to each variable in the final model was created based on model coefficients from the development cohort. Predictors of CAAs at 2 to 8&nbsp;weeks were baseline Z score of left anterior descending or right coronary artery ≥2.0, age &lt;6&nbsp;months, Asian race, and C-reactive protein ≥13&nbsp;mg/ dL (c=0.82 in the development cohort, c=0.93 in the validation cohort). The CAA risk score assigned 2 points for baseline Z score of left anterior descending or right coronary artery ≥2.0 and 1 point for each of the other variables, with creation of low- (0-1), moderate- (2), and high- (3-5) risk groups. The odds of CAA s were 16-fold greater in the high- versus the low-risk groups in the development cohort (odds ratio, 16.4; 95% CI , 9.71-27.7 [ P&lt;0.001]), and &gt;40-fold greater in the validation cohort (odds ratio, 44.0; 95% CI, 10.8-180 [ P&lt;0.001]). Conclusions Our risk model for CAA in Kawasaki disease consisting of baseline demographic, laboratory, and echocardiographic variables had excellent predictive utility and should undergo prospective testing

Trauma Early Mortality Prediction Tool (TEMPT) for assessing 28-day mortality.

Background:Prior mortality prediction models have incorporated severity of anatomic injury quantified by Abbreviated Injury Severity Score (AIS). Using a prospective cohort, a new score independent of AIS was developed using clinical and laboratory markers present on emergency department presentation to predict 28-day mortality. Methods:All patients (n=1427) enrolled in an ongoing prospective cohort study were included. Demographic, laboratory, and clinical data were recorded on admission. True random number generator technique divided the cohort into derivation (n=707) and validation groups (n=720). Using Youden indices, threshold values were selected for each potential predictor in the derivation cohort. Logistic regression was used to identify independent predictors. Significant variables were equally weighted to create a new mortality prediction score, the Trauma Early Mortality Prediction Tool (TEMPT) score. Area under the curve (AUC) was tested in the validation group. Pairwise comparison of Trauma Injury Severity Score (TRISS), Revised Trauma Score, Glasgow Coma Scale, and Injury Severity Score were tested against the TEMPT score. Results:There was no difference between baseline characteristics between derivation and validation groups. In multiple logistic regression, a model with presence of traumatic brain injury, increased age, elevated systolic blood pressure, decreased base excess, prolonged partial thromboplastin time, increased international normalized ratio (INR), and decreased temperature accurately predicted mortality at 28 days (AUC 0.93, 95% CI 0.90 to 0.96, P&lt;0.001). In the validation cohort, this score, termed TEMPT, predicted 28-day mortality with an AUC 0.94 (95% CI 0.92 to 0.97). The TEMPT score preformed similarly to the revised TRISS score for severely injured patients and was highly predictive in those having mild to moderate injury. Discussion:TEMPT is a simple AIS-independent mortality prediction tool applicable very early following injury. TEMPT provides an AIS-independent score that could be used for early identification of those at risk of doing poorly following even minor injury. Level of evidence:Level II

Development and Validation of a New Prognostic System for Patients with Hepatocellular Carcinoma

BACKGROUND: Prognostic assessment in patients with hepatocellular carcinoma (HCC) remains controversial. Using the Italian Liver Cancer (ITA.LI.CA) database as a training set, we sought to develop and validate a new prognostic system for patients with HCC. METHODS AND FINDINGS: Prospective collected databases from Italy (training cohort, n = 3,628; internal validation cohort, n = 1,555) and Taiwan (external validation cohort, n = 2,651) were used to develop the ITA.LI.CA prognostic system. We first defined ITA.LI.CA stages (0, A, B1, B2, B3, C) using only tumor characteristics (largest tumor diameter, number of nodules, intra- and extrahepatic macroscopic vascular invasion, extrahepatic metastases). A parametric multivariable survival model was then used to calculate the relative prognostic value of ITA.LI.CA tumor stage, Eastern Cooperative Oncology Group (ECOG) performance status, Child-Pugh score (CPS), and alpha-fetoprotein (AFP) in predicting individual survival. Based on the model results, an ITA.LI.CA integrated prognostic score (from 0 to 13 points) was constructed, and its prognostic power compared with that of other integrated systems (BCLC, HKLC, MESIAH, CLIP, JIS). Median follow-up was 58 mo for Italian patients (interquartile range, 26-106 mo) and 39 mo for Taiwanese patients (interquartile range, 12-61 mo). The ITA.LI.CA integrated prognostic score showed optimal discrimination and calibration abilities in Italian patients. Observed median survival in the training and internal validation sets was 57 and 61 mo, respectively, in quartile 1 (ITA.LI.CA score 64 1), 43 and 38 mo in quartile 2 (ITA.LI.CA score 2-3), 23 and 23 mo in quartile 3 (ITA.LI.CA score 4-5), and 9 and 8 mo in quartile 4 (ITA.LI.CA score &gt; 5). Observed and predicted median survival in the training and internal validation sets largely coincided. Although observed and predicted survival estimations were significantly lower (log-rank test, p &lt; 0.001) in Italian than in Taiwanese patients, the ITA.LI.CA score maintained very high discrimination and calibration features also in the external validation cohort. The concordance index (C index) of the ITA.LI.CA score in the internal and external validation cohorts was 0.71 and 0.78, respectively. The ITA.LI.CA score's prognostic ability was significantly better (p &lt; 0.001) than that of BCLC stage (respective C indexes of 0.64 and 0.73), CLIP score (0.68 and 0.75), JIS stage (0.67 and 0.70), MESIAH score (0.69 and 0.77), and HKLC stage (0.68 and 0.75). The main limitations of this study are its retrospective nature and the intrinsically significant differences between the Taiwanese and Italian groups. CONCLUSIONS: The ITA.LI.CA prognostic system includes both a tumor staging-stratifying patients with HCC into six main stages (0, A, B1, B2, B3, and C)-and a prognostic score-integrating ITA.LI.CA tumor staging, CPS, ECOG performance status, and AFP. The ITA.LI.CA prognostic system shows a strong ability to predict individual survival in European and Asian populations

MRI radiomic features are independently associated with overall survival in soft tissue sarcoma

Purpose: Soft tissue sarcomas (STS) represent a heterogeneous group of diseases, and selection of individualized treatments remains a challenge. The goal of this study was to determine whether radiomic features extracted from magnetic resonance (MR) images are independently associated with overall survival (OS) in STS. Methods and Materials: This study analyzed 2 independent cohorts of adult patients with stage II-III STS treated at center 1 (N = 165) and center 2 (N = 61). Thirty radiomic features were extracted from pretreatment T1-weighted contrast-enhanced MR images. Prognostic models for OS were derived on the center 1 cohort and validated on the center 2 cohort. Clinical-only (C), radiomics-only (R), and clinical and radiomics (C+R) penalized Cox models were constructed. Model performance was assessed using Harrell\u27s concordance index. Results: In the R model, tumor volume (hazard ratio [HR], 1.5) and 4 texture features (HR, 1.1-1.5) were selected. In the C+R model, both age (HR, 1.4) and grade (HR, 1.7) were selected along with 5 radiomic features. The adjusted c-indices of the 3 models ranged from 0.68 (C) to 0.74 (C+R) in the derivation cohort and 0.68 (R) to 0.78 (C+R) in the validation cohort. The radiomic features were independently associated with OS in the validation cohort after accounting for age and grade (HR, 2.4; Conclusions: This study found that radiomic features extracted from MR images are independently associated with OS when accounting for age and tumor grade. The overall predictive performance of 3-year OS using a model based on clinical and radiomic features was replicated in an independent cohort. Optimal models using clinical and radiomic features could improve personalized selection of therapy in patients with STS

Independent Validation of an Existing Model Enables Prediction of Hearing Loss after Childhood Bacterial Meningitis

Objective: This study aimed external validation of a formerly developed prediction model identifying children at risk for hearing loss after bacterial meningitis (BM). Independent risk factors included in the model are: duration of symptoms prior to admission, petechiae, cerebral spinal fluid (CSF) glucose level, Streptococcus pneumoniae and ataxia. Validation helps to evaluate whether the model has potential in clinical practice. Study design: 116 Dutch school-age BM survivors were included in the validation cohort and screened for sensorineural hearing loss (>25 dB). Risk factors were obtained from medical records. The model was applied to the validation cohort and its performance was compared with the development cohort. Validation was performed by application of the model on the validation cohort and by assessment of discrimination and goodness of fit. Calibration was evaluated by testing deviations in intercept and slope. Multiple imputation techniques were used to deal with missing values. Results: Risk factors were distributed equally between both cohorts. Discriminative ability (Area Under the Curve, AUC) of the model was 0.84 in the development and 0.78 in the validation cohort. Hosmer-Lemeshow test for goodness of fit was not significant in the validation cohort, implying good fit concerning the similarity of expected and observed cases. There were no significant differences in calibration slope and intercept. Sensitivity and negative predicted value were high, while specificity and positive predicted value were low which is comparable with findings in the development cohort. Conclusions: Performance of the model remained good in the validation cohort. This prediction model might be used as a screening tool and can help to identify those children that need special attention and a long follow-up period or more frequent auditory testing

Exploiting the noise: improving biomarkers with ensembles of data analysis methodologies.

BackgroundThe advent of personalized medicine requires robust, reproducible biomarkers that indicate which treatment will maximize therapeutic benefit while minimizing side effects and costs. Numerous molecular signatures have been developed over the past decade to fill this need, but their validation and up-take into clinical settings has been poor. Here, we investigate the technical reasons underlying reported failures in biomarker validation for non-small cell lung cancer (NSCLC).MethodsWe evaluated two published prognostic multi-gene biomarkers for NSCLC in an independent 442-patient dataset. We then systematically assessed how technical factors influenced validation success.ResultsBoth biomarkers validated successfully (biomarker #1: hazard ratio (HR) 1.63, 95% confidence interval (CI) 1.21 to 2.19, P = 0.001; biomarker #2: HR 1.42, 95% CI 1.03 to 1.96, P = 0.030). Further, despite being underpowered for stage-specific analyses, both biomarkers successfully stratified stage II patients and biomarker #1 also stratified stage IB patients. We then systematically evaluated reasons for reported validation failures and find they can be directly attributed to technical challenges in data analysis. By examining 24 separate pre-processing techniques we show that minor alterations in pre-processing can change a successful prognostic biomarker (HR 1.85, 95% CI 1.37 to 2.50, P &lt; 0.001) into one indistinguishable from random chance (HR 1.15, 95% CI 0.86 to 1.54, P = 0.348). Finally, we develop a new method, based on ensembles of analysis methodologies, to exploit this technical variability to improve biomarker robustness and to provide an independent confidence metric.ConclusionsBiomarkers comprise a fundamental component of personalized medicine. We first validated two NSCLC prognostic biomarkers in an independent patient cohort. Power analyses demonstrate that even this large, 442-patient cohort is under-powered for stage-specific analyses. We then use these results to discover an unexpected sensitivity of validation to subtle data analysis decisions. Finally, we develop a novel algorithmic approach to exploit this sensitivity to improve biomarker robustness